Non-equilibrium thermodynamics for functionals of current and density 
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We study a stochastic many-body system maintained in an non-equilibrium steady state. Proba- 
bility distribution functional of the time-integrated current and density is shown to attain a large- 
deviation form in the long-time asymptotics. The corresponding Current-Density Cramer Functional 
(CDCF) is explicitly derived for irreversible Langevin dynamics and discrete-space Markov chains. 
We also show that the Cramer functionals of other linear functionals of density and current, like 
work generated by a force, are related to CDCF in a way reminiscent of variational relations between 
different thermodynamic potentials. The general formalism is illustrated with a model example. 
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1. Introduction Deriving probability distributions of 
relevant physical quantities for stochastic systems out of 
equilibrium is a complex problem of great interest for 
many experimental situations. The issue is difficult be- 
cause of the complexity of non-equilibrium evolutions. In 
recent years, several models were proposed where such 
quantities could be computed. For example, the case of 
steady-state, non-equilibrium systems was studied in [lj], 
using theoretical tools developed earlier 0, Q . 

In the case when the stochastic system can be de- 
scribed by equations of hydrodynamic type, a special 
matrix-based formulation can be used jij, leading to a 
rich class of behaviors, including integrability [5|, non- 
ergodicity and non-equilibrium phase transitions [Ql, and 
interesting connections to random matrix theory [7| ■ 

In the present work, we investigate generic stochastic 
systems out of equilibrium, in the large deviation limit, 
under the assumption of continuous symmetries for the 
space of trajectories. This allows the large deviation 
functional for density and currents to be derived, using 
a different approach than in [l|, [|| . 

2. Langevin processes in symmetric spaces Consider 
a Langevin process given in a configuration space M by 
a stochastic equation 

m = Kb) + = M(* - *')> (i) 

or equivalently by a path integral with a measure 

dQ = Z- 1 cxp{-S[ V (T)]}Vr 1 (T), (2) 



for stochastic paths (maps 
and 



M) rj(t), with Vrj , Z, 



S( V ) = (l/2) / dr [ra - Fi(r,)] [m ~ F<(»j)] 



(3) 



being the functional measure, a normalization factor, and 
the action, respectively. Hereafter, summation over re- 
peated indices is assumed. We use rescaled units so that 
the temperature of the thermal bath, modeled by the 
Langevin term in pj). is equal to one. We are interested 



in large deviation (t — > oo) relations for stochastic tra- 
jectories of the process (JTJ), in the case when the system 
exhibits continuous symmetries preserving the metric in- 
duced by the force field F (isometries). For a compact 
representation of stochastic trajectories, we introduce the 
fluctuating density and current at a point x of the tra- 
jectory's configuration space 



Hi (17, x) = \ J* dTf]i8{x - 77(1-)). 



(4) 
(5) 



In the next section we will derive the large-deviation limit 
of the joint probability distribution function for g, 3: 



V[J(x),p(x)] = (S( Q -p)5(2-J)h 



(6) 



We will show that in the t — ► 00 limit, it takes the form 
V{J,p) - exp[-iS(J,p)], where the CDCF is 



S(J,p) 



dx 



M 



[Fp-J-{l/2)dpf 
2p 



(7) 



We will also obtain a similar large-deviation result for 
discrete Markov processes. 

The explicit large deviation result (J7J) can be imme- 
diately used to get thermodynamics-like relations for 
Cramer functions of derived objects. One introduces 
the vector and scalar potentials (which can also be inter- 
preted as gauge fields, i.e. generators of continuous sym- 
metry transformations mentioned above), V(x),A(x) 
and the corresponding charges 

W A Q) = J M dxAj(xp(r];x) = \ f Q drf? A^rj), 
u v (g) ee J M dxV(x)g( V ; x) = \ f* drV(r,(r)). (8) 

At t — * 00, the joint p.d.f. V(w,u) = (5(w — wa(^))S(u — 
u v(q))}$, of waO) and uv{g) has the large deviation form 
T- > [A,v]( w ,u) ~ exp(— tS[A,v]{w, u)), where 

S[a,v](w,u) = inf S(J,p). (9) 

■wa{J)—w,uv{P)—u 
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3. Derivation for the Langevin processes Using a 
standard representation for the Dirac 5-functional ([6]) 
gives for the probability V{ J, p) ~ 

JvA{x)VV{x)e~ u I d *i A J+ v f>) Jv V (t)e- s ^ A ^ , 

S( V ;A,V)=S(r,)-i fdrtfAM + Vir,)), (10) 
Jo 

where T>A(x), W(x) are the standard field-theoretical 
notations for functional differentials/measures. 

In the large deviation limit (t — ► oo), the path integral 
in (fT0|) is estimated as 

yPr/(T)e~ s(7);A ^ ) oc exp (£F(A, V)) , where (11) 

F(A,V) = J dx£ A}V p(x), and (12) 
t A>v = {l/2)VjVj-VjFj+iV, V, r;„ /.l,. (13) 

with p(cc) the normalized right-eigenvector of the ground 
state (lowest eigenvalue) for the Fokker-Planck operator 

£-A,vP = <\o, and / dxp(x) = 1. (14) 

Applying further the saddle-point approximation for 
the functional integral in (fTOf with respect to A, V, and 
using (|10I11I12I13[) . we arrive at the following equations: 

J(x) = (F + iA-{l/2)d)p(x), p = p. (15) 

Solving (|14I15[I for A, V and p and substituting the result 
back in the saddle expression for (fTO)) yields ([7]). Note 
that the final result does not depend on A, although it 
explicitly enters (fT4|) . 

Notice that for the physical current, di Jt = 0, and the 
functional integration measure in (|10[) is invariant with 
respect to the gauge transformation, Aj — > Aj + djtp. In 
deriving (|11I12|) from (fT0|) . the gauge freedom was fixed 
by the requirement that the left cigcnfunction of Ca,v 
conjugated to the right eigenfunction, p, equals unity. 

4- Comments (i) The variational principle ^ es- 
tablishes the optimal-fluctuation picture of the distri- 
butions V(w,u]t) at long times on the level of cur- 
rents/densities: The relevant probability u\ t) is de- 
termined by the probability V( J, p\ t) of the optimal dis- 
tributions (J(x), p(x)) of current and density that corre- 
spond to the maximal probability, provided they repro- 
duce the correct set of rates (w,u) as in ([9]). 

(ii) Comparison of the probability of a stochastic 
trajectory 77 and its time-reversed counterpart, com- 
bined with the fact that the entropy production along 
77 depends on the correspondent current distribution 
2({r]},x) only, leads to the fluctuation theorem relation 
9 for the CDCF 

S(-J,p)-S(J,p)=2w F (J). (16) 



(iii) The special choice of the gauge (fl~5j) has a sim- 
ple geometric interpretation: solving a heat-kernel type 
equation for operator (fl~3|) with delta-function initial con- 
dition usually leads to a gaussian solution with increasing 
variance. However, it is possible to apply infinitesimal 
gauge transformations such that the solution remain sin- 
gular at all times. The gauge (p~5|) achieves this result. 

(iv) The fact that in the large time limit t — > 00 it 
is possible to approximate the effective action with a 
quadratic form in the gauge fields (which is equivalent 
to |(7J)), can be traced back to the formal expansion of 
the (gauged) heat kernel [1] 

{x\e tD \x) = (4irty d / 2 [l + t ai + ...}, (17) 

where D = + X is a gauged heat kernel in d 

dimensions, and a\ is the first Seeley coefficient, a\ = 
—X — ^(Afj,), with oj a quadratic form. This result holds 
for compact spaces; for a generalization to spaces with 
(possibly fractal) boundary, see fiol ]. 

(v) The result ([7|) can also be understood in very gen- 
eral terms starting with the problem of computing the 
current algebra (and hamiltonian) of sigma models in 
symmetric spaces (a field theory for maps into Riemann 
spaces with simple compact isometry group). In this set- 
up, the force field F provides a metric, and the contin- 
uous symmetry group preserves the metric. It is known 
[HI that the functional of currents for this theory has 
the form ([7]). This result was also used in the context of 
mesoscopic transport theory 

5. Derivation for irreversible Markov chains Irre- 
versible Markov Chain (MC) stochastic dynamics can 
be viewed as a discrete (regularized) counterpart of the 
Langevin processes, that also occur in continuous time. 
We start with formulating the MC dynamics such that 
the formalism reported above can be applied with only 
minor changes. The configuration space M is a graph 
that consists of vertices a € M and edges {a, 6} S Mi. 
An edge {a, b] will be further denoted a — » b or b <— a. A 
Markov process is determined by a set of rates k a t =/= kb a 
that reside on the graph edges. A discretized stochastic 
trajectory 77 = (a„, . . . , a ; r„, . . . , n) with a i+1 — » aj 
and < Ti < . . . < t„ < t represents a set of instan- 
taneous jumps from a^-i to aj that occur at times Tj 
respectively. The Markovian measure Vr/ exp (— S(rj)), 
with Dr] = dr\ . . . dr n , is described by the action 

n 

exp (-5(77)) = n^-i e_EIU,iai(T,+1 ~ ri) . ( 18 ) 

3=1 

where n a — ^2 b ^ a k\> a is the rate of leaving the site a. 

Similar to (|4I5|) , we can define the density p a {il) and 
the current J a b(v) associated with a trajectory 77, as the 
relative portion of time spent on a, and the number of 
jumps b — > a minus the number of jumps a — > b divided 
by t, respectively. If a trajectory is closed we have the 
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current conservation J^b^a Jba(v) — 0- Correspondingly, 
functionals uv(p),wa{J) represent the time-average of 
function V : M — > R relative to the distribution p, and 
the weighted average of function A : M\ — > Si (the unit 
circle), with respect to the distribution of jumps J. 

The variational principle © for the discrete case can 
be derived exactly in the same fashion as for the contin- 
uous case using the integration measures W = Y[ a dV a , 
and VA = Y\ a ^ b (2iriz a b)~ 1 dz a b. The fields V and A 
arise, as in (flC)]) . from the representation of Dirac's dis- 
tribution for (J5|). The integrations dV a and dz a b go over 
the real axis and the unimodular circle \z a b\ — 1, re- 
spectively. As in the continuous case, the CDCF S(J, p) 
can be computed using the Fokker-Plank (FP) approach, 
which results in the expression (Tl3"|) with the modified FP 
operator 



ab 



kabZab&ab 



(«a + V a ) <t a 



(19) 



where a ab = l a )(&|- Note that for J, V — 0, the operator 
C represents the rate matrix of the master equation, so 
Ca.v can be referred to as the modified rate matrix. 

Similar to the continuous case, the functional S(J,p) 
can be identified explicitly, by fixing the gauge using con- 
ditions ipA,v — Pa and J- {A, V) — 0. Thus, p is the zero 
mode of the modified FP operator (I19| . This results in: 



S{J,P) = ^2 J ab(ab + ^PaVa, 



(20) 



ab 



Jab = k ab Z ab p b - kbaZbaPa = k ab Z ab p b - fo a Z a b Pa, (21) 

with Cab = hi(z ao ). We further make use of (f2~lj) to ex- 
press z a b in terms of {J, p) and of the gauge fixing condi- 
tion ^(A, V) = combined with the explicit form of the 
modified FP operator (|19p to find an explicit expression 
for V a . Upon substitution of these expressions into (|20|) 
we arrive at the explicit expression for the CDCF 



S(J, P) = Ka P° ~ ^2 \J J ab + ^KbhaPaPb 
a ab 



E T , \J Jab + ^kabhaPaPb + Jab 
Jab In —, • 
2fc ao p b 

ab 



(22) 



The variational principle can be applied to calculate 
the long-time distributions of the production rates for 
the observables represented as linear functions of cur- 
rent/density. In particular we have for the entropy pro- 
duction rate: 



>(J) = ^ Jab In {kab/ha) 



(23) 



6. N on- equilibrium thermodynamics for systems of 
identical particles In this section we illustrate how to 
derive a single-particle, coarse-grained, version of ijTj). 



This is a potentially productive approach for addressing 
steady, non-equilibrium situations in stochastic systems 
of interacting particles [H, 14, TEl ]. 

Consider a system of N interacting Langevin processes, 



Vi 



Fi(rii,--- ,»7iv) + &(*)) m 6 



(24) 



We introduce the multi-point density and currents de- 
pending on all trajectories {r)i(T)}fL 1 and markers 

W; v , 

qW = \ J* dr Uk=i,..N S (Vk(j) - x k ) , (25) 

l\ N) = i /* drmir) Uk=i,..N 6 fokto - **) ■ ( 26 ) 

The multi-point effective action (0 for the joint p.d.f. 
of the multi-point density and currents, (S(p( N ' — 



)nt 1 ^ W -3f ) ))ocexp(-^) ) ,is 



5 W = W 
I, J 



d N X 



F*pW - J, 



(N) 



dx k p 



(N) 



(27) 



Averages over i, = i f Q dr^k 5 (%(t) - x), J (0) = 
Wt Jo d T Hk Vk {t)S (n k (t) - x) describe single-particle 
density/currents. The effective action that controls the 
long-time asymptotic of the single-point p.d.f. {8{p^ — 
oc exp (-iS (0) ) is related to the multi- 
point action (|27| via the exact variational relation 



S (0) = inf p («),j(«), 



)S (N) 



(28) 



o(0) 



(x) = N-ifll i dx i Z k P iN) S( 



Xk 



j(°Hx)=N- 1 m i dx i j: k Jl" ) 6(x k 



x) 
-x) 



This can be derived by looking for the minimum of (|27p , 
subject to constraints (|28|) . using Lagrange multipliers. 

We now show how to derive asymptotic results for this 
example of a many-body system of interacting particles 
on a circle, with nearest-neighbor interactions, for a con- 
stant force field F. Starting from the discrete version 
of the model, we will consider the hydrodynamic limit 
N — ► oo and obtain a smooth continuum model. Equa- 
tions for interacting Langevin processes {fa € Si}£Li are 



fa = uN(fa-fa- 1 )+vN 2 



'H+l 



+ fa- 1 -2fa) + F + £ i (t), 



with u, v effective parameters fixed by the interaction. 
In order to consider the hydrodynamic N — * oo limit, we 
introduce the field (p(i, t) whose value at i is the Langevin 
process fa. A similar construction gives the noise field 
t). In the hydrodynamic limit, the indices form a 



continuum 



' N 



y E Si and the evolution is given by 



(p(y,t) = u 



dip(y,t) d 2 if{y,i) 



dy 



+ v 



dy 2 



+ F + £{y,t). (29) 



We can now apply the formalism presented earlier to 
compute the current in the continuum limit. It will 
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depend on the connectivity component, n. This integer 
parameter allows to separate particles in groups accord- 
ing to the number of expected full cycles completed in 
the large time limit. To illustrate this, consider runners 
on a circular track, and separate the group which com- 
pletes between n and n + 1 turns in a given time. We call 
that group a component, characterized by the integer n. 
Performing a twisted Fourier decomposition 



Note After the research described in this Letter was 
completed, we have learned about similar results ob- 
tained recently in (l7| . Unlike in this work, they were 
obtained using a standard formulation We empha- 
size that our approach is different and allows more gen- 
eral types of interactions between Langevin processes. 



E 

fe=i 



ip(y,t) = ny + ^ (t) + y ] W{t)e lky + b k {t)e 



-iky] 



(30) 



allows the minimization in (|28|l to be performed explic- 
itly. This results in a set of Cramer functions for current 
J and density p{f>), labeled by n 



(F + un)p — J 



\d vP 



(31) 



By symmetry, minimization with respect to p in (|3ip 
yields p{tp) — 1, and results in Gaussian distributions 
for J, peaked at F + un. The time-averaged current does 
not depend on the parameter v, which describes the diffu- 
sive part of the process, but only on u, which is related to 
drift around the circle. This is a natural conclusion upon 
analyzing averages of derivatives for (f3T)]) : except for the 
linear term ny, all others average to zero due to their os- 
cillatory nature. Hence, contributions are expected only 
from the terms depending on first-order derivatives. 

7. Notes on further potential applications Turbulence 
is often modeled via a set of stochastically driven differ- 
ential equations, which can be regularized in terms of 
interacting Lagrangian particles subjected to stochastic 
stirring and damping. Thus, a model describing the 3D 
evolution of a representative turbulent blob in terms of 
four-point configurations was presented in [l6| . Consid- 
ering coordinates and momenta of the Lagrangian parti- 
cles as degrees of freedom, one maps the particle system 
onto the general model ([T]). Analyzing various function- 
al of relevant densities and currents (introduced for both 
the coordinates and momenta of the Lagrangian parti- 
cles) and relating them to standard objects of interest 
in stochastic hydrodynamics, e.g., distribution functions 
of energy and density fluxes in momentum space, consti- 
tutes an intriguing new direction for future research. 
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